(19) 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(43) Date of publication: 

12.07.2000 Bulletin 2000728 

(21) Application number: 99124913.7 

(22) Date of filing: 14.12.1999 



iigwiiiwiiiDDnniii 

( ii) EP 1 018 835 A2 

EUROPEAN PATENT APPLICATION 

(51) lntCl7: H04N 5/00 



(84) Designated Contracting States: 

AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 
MC NL PT SE 

Designated Extension States: 
AL LT LV MK RO SI 

(30) Priority: 08.01.1999 GB 9900333 

(71) Applicant: Pace Micro Technology PLC 
Shipley, West Yorkshire BD18 3LF (GB) 



(72) Inventors: 

• Nooralahiyan, Amir 

Bramhope, West Yorkshire, LS16 9BE (GB) 

• Mehra, Rahul 

Pudsey, Leeds LS28 7TN (GB) 

(74) Representative: Wood, Graham 
Bailey Walsh & Co, 
5 York Place 
Leeds LS1 2SD (GB) 



(54) Improvements relating to a video data receiver and method of displaying these data 



(57) The invention relates to an improvement in re- 
ceivers for receiving broadcast video data for generating 
a video display from said data and also to the method 
ol displaying said data. The invention provides for a 
memory into which received data can be directed and 
said data may also at the same time or previously have 
been used to generate a video display on a display 
screen. The data in the memory can be called up to gen- 
erate a video display thereafter and the speed of the dis- 



play may be selected so as to provide, for example, a 
slow motion or freeze frame display. The facility allows 
the user to select to regenerate a display which they may 
already have seen at the initial video display and further 
to generate the display in a slow motion sequence. The 
memory can be updated with newly received data. In 
addition, or alternatively, the memory may be provided 
to receive packets of data which are selected for storage 
and said packets of data in conjunction to provide a data 
sequence which can be selected to be viewed. 
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Description 

[0001] The subject matter of this invention relates to 
improvements for receivers of the type used to receive 
transmitted broadcast video signals and particularly, al- s 
though not necessarily exclusively, the digital signal re- 
ceiver. A digital receiver allows the transmitted data 
which is in an encoded format to improve efficiency and 
reduce code length, to be received, decoded and dis- 
played on screen for viewing. 10 
[0002] A known problem with digital data receivers is 
that while they decode and display broadcast informa- 
tion efficiently they are at present only capable of acting 
as "real time" processing devices and do not hold any 
significant historical information. This means that the is 
viewer of the television or other means connected to the 
receiver is denied the opportunity to repeat the last 
quantity of video data to be displayed in normal replay 
or slow motion mode. This is however a leature which 
has been found to be desirable as the viewer may wish 20 
to review some material which has previously been dis- 
played and can be used in many different functions such 
as, for example, when viewing sports events to look at 
a goal or particularly skilful piece of play. 
[0003] The aim of the present invention is to allow the 2$ 
ability for a receiver to be provided with replay and/or 
slow motion functions for video content which is re- 
ceived and displayed on a television set or other display 
medium. 

[0004] In a first aspect of the invention there is provid- 30 
ed a receiver for the reception of transmitted data and 
generation of a display of the video data on a display 
screen connected therewith, said receiver including a 
physical memory in which video data is stored and from 
which, for a time period following display, said video data 35 
can be selectively retrieved to create a video display on 
the display screen and characterised in that said mem- 
ory includes a first portion of memory which receives the 
most recently transmitted data received by the receiver 
at each instant, and a remainder portion in which is *o 
stored, in sequence, packets of data which have previ- 
ously been received and displayed and have been 
transferred from said first portion over time. 
[0005] In a preferred embodiment of the apparatus 
there is provided a transmitted data receiver tor the re- «s 
ception of data and generation of a display of the video 
data on a display screen and wherein said receiver in- 
cludes a physical memory, in which video data is stored, 
which video data can be selectively used to create a vid- 
eo display on the display screen and the memory in- so 
eludes a first portion which acts as a moving buffer mem- 
ory portion which moves and is updated with the pas- 
sago of time and into which the most recently displayed 
data packets are stored. Over time the first portion is 
updated with more recent data packets and the data 55 
packets previously held in the first portion move into the 
second portion of the memory which stores the data 
packets in time order for a period of time, the length of 
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which can be determined at least partially by the size of 
the memory. Typically a circular memory construction-is" 
used and, as the first portion "moves" around themem- 
ory, and is updated and receives the most recently dis- 
played data, so the oldest data held in the second por- 
tion is overwritten and this process continues as data 
continues to be processed and displayed by the receiv- 
er. Thus in a preferred embodiment, at any one time, the 
memory, in accordance with the invention, holds data 
which has most recently been processed and displayed 
and further data in time order therefrom up to a certain 
historical time limit and the data held in that memory can 
be retrieved for display upon command by the user of 
the apparatus and in one of plurality of user selectable 
formats. 

[0006] In one embodiment the video data stored in the 
memory has been used to generate a video display. 
[0007] Thus the memory receives data from the data 
transport stream from the broadcaster and the same is 
used to generate the video display and al the same time 
is stored in the physical memory so that at any instance 
a predesignated quantity of the most recently received 
data is readily available in the memory. 
[0008] Preferably the memory is a circular buffer 
memory in operation which means that the content of 
the memory at any one time is successively overwritten 
as new packets of video data are routed to and through 
the memory to replace the oldest data in the memory 
and so on. 

[0009] Preferably the capacity of the memory is set so 
as to be sufficient to allow the storage of meaningful 
quantities of data so as to facilitate the storage of a dis- 
played video content or a series of packets of data so 
that the video packets are accessible for a predeter- 
mined period of time following display to allow the same 
to be replayed or for the same to be used in slow motion . 
Typically the length of the video packets which can be 
viewed after initial display is directly proportional to the 
size of the buffer memory provided and the capacity is 
such as to allow a video display of a meaningful length 
to be displayed in slow motion or replay mode. 
[0010] In a further feature of the invention, the display 
interrupt at the video driver layer can be manipulated in 
respect of the contents of the buffer memory so that the 
same can be displayed at variable speeds to achieve 
the effect of variable slow motion. 
[0011] In a further aspect of the invention there is pro- 
vided a melhod of receiving and displaying transmitted 
data, said method comprising the steps of: 

encoding a stream of data into digital encoded data; 
transmitting the encoded data for reception by at 
least one data receiver; 

decoding the received data into a form for the gen- 
eration of a video display on a display screen con- 
nected to the data receiver and characterised in that 
the data receiver includes or is connected to a mem- 
ory in which the received data can be stored for se- 
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lected-retrieval within a time period after the initial 
display to create a video display, and wherein said 
memory includes a first portion into which the most 
recently received data is placed, and a remainder 
portion into which data from the first portion passes. 

[001 2] In one embodiment the received data is simul- 
taneously decoded to create the video display and 
saved in the memory for selective use in generating a 
display. 

[0013] In one embodiment the memory contains 
packets of received data with the oldest packets of data 
overwritten by most recently received packets of data 
over time. 

[0014] In an alternative embodiment packets of data 
can be selectively stored in a memory to generate a se- 
ries of packets of data lor selected display, such as tor 
example, a series of packets of data representing the 
highlights of a broadcast sporting event. 
[001 5] In one embodiment the speed of the display of 
data from the memory can be selected, and may be, for 
example, selected to provide a slow motion display of 
the data, or even a freeze frame effect. 
[0016] In a yet further aspect of the invention there is 
provided a receiver for the reception of transmitted data 
and generation of a display of the video data on a display 
screen connected therewith, said receiver including a 
physical memory in which video data is stored and from 
which, foratime period following display, said video data 
can be selectively retrieved to create a video display on 
the display screen and characterised in that said mem- 
ory includes a first portion defined as the portion of the 
memory defined between the producer and consumer 
pointers which receives the most recently transmitted 
data received by the receiver at each instant, and a re- 
mainder portion of the memory and in which is stored, 
in sequence, packets of data which have previously 
been received and displayed and which are transferred 
from said first portion as producer and consumer point- 
ers move around the circular memory configuration. 
[0017] The invention as herein described provides 
novel features in that it can provide a freeze frame func- 
tionality, can allow the replay of previously displayed vid- 
eo clips and can allow* the replay of the same as many 
times as required. In other functions, the invention also 
provides for slow motion functionality and allows for the 
variation in slow motion speed as required. 
[0018] Specific embodiments of the invention will now 
be described with reference to the accompanying draw- 
ings, wherein:- 

Figure 1 illustrates the basic interaction of the main 
processes responsible for TS input, dc-scrambling, 
de-multiplexing/routing of the TS content and the 
video replay task; 

Figure 2 illustrates the operation of the memory in 
the form of a buffer in one embodiment; and 



Figure 3 illustrates in schematic form the replay of 
the stored video data. 

[0019] To allow the receiver with memory storage to 
s be operated the following steps are followed with refer- 
ence to Figure 1. Tasks are initialised at start-up and 
instantiated to run concurrently: The TS-IN process 
compares the Packet ID (PID) of the incoming Transport 
Packet with the PID Action Table held in the memory of 
10 the receiver to distinguish between packets that should 
be routed to the memory and the packets of data which 
can be rejected. The TS-IN process initially searches for 
PID 0 which contains the Program Association Table 
(PAT). The DVBC process determines whether or not 
is the data packet needs unscrambling and, if so, and a 
valid key exists, the packets are decrypted and 
repacked before being passed on to the DEMUX proc- 
ess. The DEMUX process establishes the type of pay- 
load by examining and extracting the relevant intorma- 
20 tion from the PID table and routing il to the relevant proc- 
ess. For example, if the information is video, it is routed 
to the VIDEO process and so on. VIDEO, AUDIO and 
other consumer processes provide simple interfaces to 
the device drivers. The REPLAY process interacts with 
25 the DEMUX/Routing process and the Video process. 
The VIDEO process typically can not receive video 
packets from DEMUX and REPLAY processes simulta- 
neously Circular buffer memories are used for inter- 
process communication. 
30 [0020] The interaction between the DEMUX routing 
process (producer) and the VI DEO process (consumer) 
utilises a short buffer of few data packets. This is to say 
that as soon as these few packets of video data are 
available, they are routed to the video process. This, in 
35 turn, interacts with the video driver. Thus, the producer 
pointer is constantly moving round the circular buffer 
and is followed closely by the consumer pointer as illus- 
trated in Figure 2 to define a first portion of the memory 
in accordance with the invention. The dotted line 2 con- 
40 sists of previously decoded and displayed video packets 
and is referred to as the second or remainder portion of 
the memory in accordance with the invention also re- 
ferred top as the history loop. When the receiver or set 
top box (STB) is instructed to operate the video replay 
45 mode such as by the reception of a signal from a remote 
control, the REPLAY process first interrupts the DEMUX 
process and halts the subsequent routing of the video 
dala packets. The REPLAY process then lakes over the 
task of the DEMUX/Routing process and channels the 
so video packets in residence in the history loop (in the 
memory) to the VIDEO process. 
[0021] The implementation of video replay is 
achieved by accessing the video packets in the history 
loop and the packets are subsequently interfaced to the 
55 video driver. The length of the history loop is dependent 
on the physical size of the memory in the receiver in ac- 
cordance with the invention. 

[0022] The implementation of slow motion replay is 
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somewhat different in that, while video replay may be 
accomplished at process level, the slow motion func- 
tionality is implemented at driver level. This is because 
packets depicted in the circular buffer memory have no 
timing relationship with adjacent packets. Thus a simple 
delay mechanism between packet transfer to video driv- 
er would not result in the desired slow motion effect. As 
shown in Figure 3, the REPLAY task sets the slow mo- 
tion interval and this is used as a parameter in the driver 
interrupt handling routine to adjust the number of times 
a picture field/frame is displayed. 
[0023] There are two approaches to achieve the de- 
sired effect in slow motion depending on whether the 
source picture encoding is field-based or frame-based. 
In the case of frame based encoded video data, both 
display fields of the picture are at the same temporal 
reference. In this case the slow motion is achieved by 
repeatedly displaying both fields of the decoded picture 
to obtain the desired degree of slow motion. In the case 
of field-based encoded video data the two fields belong- 
ing to the same picture are at different time instances 
with the second field occurring after the first. In this sce- 
nario the slow motion requires the repetition of each field 
separately. Two known techniques; vertical intra-field in- 
terpolation or horizontal inter-field interpolation, have 
been implemented to smooth out the effect of artefacts. 
[0024] Another implication of slow motion replay is the 
number of frame (picture) buffers allocated for decoding 
and displaying a sequence. In a 4-trame buffer alloca- 
tion, 2 frames are utilised for reference frames (I or P 
frames) and in the worst case scenario in a GOP se- 
quence, whereby there is more than one B frame be- 
tween two reference frames, one frame buffer is used 
for decoding the current B frame while the remaining 
frame buffer is used to display the previously decoded 
B frame. In a 3-frame implementation two reference 
frame buffers are used, leaving one buffer to share the 
decoding and displaying the B frames. This is achieved 
by overwriting the rows of the buffer already displayed 
with the decoded information for the next frame. Thus 
in a 3-frame buffer allocation, where the decoding and 
display of the video data is field-based, the information 
in the buffer for B frame is overwritten and potentially 
lost at every VSYNC. In this case the decoding must be 
halted during displaying the same B frame repeatedly 
to achieve the slow motion effect. 
[0025] A specific example of the video replay and slow 
motion functions is now described for the purpose of il- 
lustration and in a non-limiting manner on the interpre- 
tation of the scope of the patent application and in the 
invention described herein. 

[0026] In this specific example, the physical memory 
in the receiver is increased from 4 MBytes to 8 Mbytes 
of DRAM. This provides a memory heep size of 6 
Mbytes which is capable of containing, a link-list of 
30.000 video packets in the history or second portion of 
the memory loop which equates to about six seconds of 
video replay in real time. 



[0027] The video replay is therefore implemented us- 
ing the folbwing steps: 

1 . Interrupt and halt the DEMUX/Routing process 
5 2. Assign the consumer pointer to the producer 
pointer (i.e. at the beginning of the history loop) 

3. Advance the consumer pointer to the NEXT video 
packet 

4. Route the video packet to the video process 
io 5. DMA the history packets to the video driver 

6. Decode and display the video packets in the his- 
tory loop 

7. Repeat from No. 3 until the consumer pointer 
completes the history loop 

is 

[0028] The video replay in slow motion can be imple- 
mented using in this embodiment 3-frame buffer alloca- 
tion for A GOP of I.B.P.B.P.....B sequence with field 
based decoding of pictures. The slow motion is then im- 
20 piemenled by repealing the display function for both 
fields of each frame in the GOP sequence. 
[0029] The implementation of freeze frame can also 
be achieved by interrupting the DEMUX process to halt 
the Routing of video content to the driver. For improved 
2S clarity of image, the freeze frame avoids B frames and 
latches to the nearest reference frame (I or P frame). 
[0030] These functionalities can be operated by a re- 
mote control and accessed by a freeze-f rame button on 
the remote control to halt the DEMUX/Routing process. 
30 Once the receiver is in freeze-f rame/replay mode, other 
buttons are used for replay and slow motion functional- 
ities. Button no. 1 is used for normal replay and button 
nos. 2 to 9 are used for varying the speed of slow motion 
replay with button no. 9 being the slower replay (about 
2.8 frames per second) select button. Pressing the 
freeze-frame button again re-installs DEMUX/routing 
tasks and the receiver switches to normal mode. 



40 Claims 

1 . A receiver for the reception of transmitted data and 
generation of a display of the video data on a display 
screen connected therewith, said receiver including 

is a physical memory in which video data is stored and 
from which, for a time period following display, said 
video data can be selectively retrieved to create a 
video display on the display screen and character- 
ised in that said memory includes a first portion of 

so memory which receives the most recently transmit- 
ted data received by the receiver at each instant, 
and a remainder portion in which is stored,- in se- 
quence, packets of data which have previously 
been received and displayed and which are trans- 

55 f erred from said first portion over time. 

2. A transmitted data receiver according to claim 1 
characterised in that the input of data into the first 
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portion causes the movement of previously held da- 
ta from the first portion into the remainder portion 
and. if the capacity of the remainder portion is filled, 
the removal of the oldest data from the remainder 
portion and so on in a progressive manner over 
time. 

3. A transmitted data receiver according to claim 2 
characterised in that the memory operates as a cir- 
cular or loop configured memory so that when ca- 
pacity of the memory remainder portion is reached 
the same is successively overwritten as new pack- 
ets of data are routed to and through the memory 
to replace the oldest data in the memory and so on. 

4. A transmitted data receiver according to claim 1 
characterised in that the capacity of the memory is 
sufficient to allow the storage of quantities of data 
to facilitate the storage of a displayed video packet 
or series of packets for a predetermined period of 
time following display to allow the same to be re- 
played or for the same to be used in slow motion. 

5. A transmitted data receiver according to claim 4 
characterised in that the length of the video display 
which can selectively be viewed after initial display 
is directly proportional to the size of the moving cir- 
cular buffer memory provided. 

6. A transmitted data receiver according to claim 1 
characterised in that the display interrupt at the vid- 
eo driver layer is manipulated in respect of the con- 
tents of the memory so that the selected data can 
be displayed at selected variable speeds of display. 

7. A transmitted data receiver according to claim 1 
characterised in that there is provided a facility to 
select to save a specified packet of data in a mem- 
ory and to add further packets of data to said mem- 
ory selectively. 

8. A transmitted data receiver according to claim 7 
characterised in that the saved packets of data can 
be re-displayed individually or as a sequence of 
packets ol data. 

9. A receiver according to claim 1 characterised in that 
the first memory portion acts as a buller. 

10. A receiver according to claim 9 characterised in that 
the first portion is defined as the portion of the mem- 
ory which lies between the producer and consumer 
pointers. 

11. A receiver according to claim 10 characterised in 
that the producer and consumer pointers move 
around the circular configured buffer over time, and 
as they do so overwrite the oldest data held in the 



memory at that time. 

12. A method of receiving and displaying transmitted 
data, said method comprising the steps of: 

5 

encoding a stream of data into digital encoded 
data; 

transmitting the encoded data for reception by 
at least one data receiver; 
to decoding the received data into a form for the 

generation of a video display on a display 
screen connected to the data receiver and 
characterised in that the data receiver includes 
or is connected to a memory in which the re- 
ts ceived data can be stored for selected retrieval 
within a time period after the initial display to 
create a video display, and wherein said mem- 
ory includes a first portion into which the most 
recently received data is placed, and a remain- 
20 der portion into which data from the first portion 
passes. 

13. A method according to claim 12 characterised in 
that the received data is simultaneously decoded to 

25 create the initial video display and saved in the first 
portion in the memory for selective use in generat- 
ing a display thereafter. 

14. A method according to claim 12 characterised in 
30 that the memory contains packets of received data 

with the oldest packets of data overwritten by the 
most recently received packets of data over time. 

15. A method according to claim 12 characterised in 
35 that packets of data are selectively stored in a mem- 
ory to generate a series of packets of data for se- 
lected display. 

16. A method according to claim 12 characterised in 
40 that the speed of the display from the memory can 

be selected by the user. 

17. A method according to claim 16 characterised in 
that the speed of display is selected to provide a 

45 slow motion display of the data. 

18. A receiver for the reception of transmitted data and 
generation of a display of the video data on a display 
screen connected therewith, said receiver including 

so a physical memory in which video data is stored and 
from which, for a time period following display, said 
video data can be selectively retrievedto create a 
video display on the display screen and character- 
ised in that said memory includes a first portion de- 

55 fined as the portion of the memory defined between 
the producer and consumer pointers which receives 
the most recently transmitted data received by the 
receiver at each instant, and a remainder portion of 
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the memory and in which is stored, in sequence, 
packets of data which have previously been re- 
ceived and displayed and which are transferred 
from said first portion as producer and consumer 
pointers move around the circular memory config- s 
u ration. 
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(54) Improvements relating to a video data receiver and method of displaying these data 



(57) The disclosure relates to an improvement in re- 
ceivers for receiving broadcast video data for generating 
a video display from said data and also to the method 
of displaying said data. The disclosure provides for a 
memory into which received data can be directed and 
said data may also at the same time or previously have 
been used to generate a video display on a display 
screen. The data in the memory can be called up to gen- 
erate a video display thereafter and the speed of the dis- 



play may be selected so as to provide, for example, a 
slow motion or freeze frame display. The facility allows 
the user to select to regenerate a display which they may 
already have seen at the initial video display and further 
to generate the display in a slow motion sequence. The 
memory can be updated with newly received data. In 
addition, or alternatively, the memory may be provided 
to receive packets of data which are selected for storage 
and said packets of data in conjunction to provide a data 
sequence which can be selected to be viewed. 
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